This is a high-quality quantized version of Moonshot AI's Kimi-K2-Instruct-0905 model, using the HQ4_K quantization method. It is specifically optimized for inference performance, supports a context length of 75,000, and is suitable for text generation tasks.
Natural Language Processing
GgufOther